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Queueing networks are typically modelled assuming that the arrival process is exogenous, and unaffected by 
admission control, scheduling policies, etc. In many situations, however, users choose the time of their arrival 
strategically, taking delay and other metrics into account. In this paper, we develop a framework to study 
such strategic arrivals into queueing networks. We start by deriving a functional strong law of large numbers 
(FSLLN) approximation to the queueing network. In the fluid limit derived, we then study the population 
game wherein users strategically choose when to arrive, and upon arrival which of the K queues to join. 
The queues start service at given times, which can potentially be different. We characterize the (strategic) 
arrival process at each of the queues, and the price of anarchy of the ensuing strategic arrival game. We 
then extend the analysis to multiple populations of users, each with a different cost metric. The equilibrium 
arrival profile and price of anarchy are derived. Finally, we present the methodology for exact equilibrium 
analysis. This, however, is tractable for only some simple cases such as two users arriving at a two node 
queueing network, which we then present. 
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1. Introduction 

This paper is motivated by the following scenario: Users arriving at a concert, a game or at a store 
for Black Friday sales, where arriving before others is preferable, are faced with the dilemma of 
when to arrive. Should one arrive early before others and wait a while for service to start, or arrive 
late and wait less, and yet by which time the best seats or deals may already be gone? In such 
settings, when rational users make strategic decisions of timing, we cannot assume that the arrival 
process can be modelled by an exogenous renewal process such as a Poisson process. Furthermore, 
there may be multiple queues (which may start service at different times) and arriving users may 
have a choice of which queue to join. 

Similarly, users downloading large files from a website often time their downloads to times of 
day when network congestion is expected to be lower (e.g., late at night.) Moreover, upon arrival 
(at the web-site), they may have to choose which server to download from. A natural question to 
ask is "Does an equilibrium arrival process exist"? If it does, is it efficient with respect to some 
metric? If not, can we bound the amount of inefficiency? We answer these questions by modeling 
this strategic arrival behavior as a game that we call the network concert queueing game. Such 
strategic analysis of queues was introduced in Juneja and Jain (2009), Jain et al. (2011) for a single 
server FIFO queue. In this paper, we extend that analysis to a network of queues. 

In this paper, users choose their arrival time into a parallel queueing network wherein queues 
serve at different rates, and start service at different times. We assume servers are work-conserving 
with infinite buffers. Users can start to queue even before service starts, and do not renege or 
balk. We also consider that users may belong to multiple populations, each with different cost 
characteristics. The game is analyzed in the fluid approximation setting which offers significant 
analytical simplicity and tractability, while still capturing essential features of the problem. Each 
arriving user chooses a queue to join, and a time to arrive that minimizes a linear cost that is 
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a weighted function of the waiting time and the service completion time. The service completion 
time of a user depends on the arrival time, and may be considered as a proxy for the latter metric. 

We make two main contributions in this paper. Our first contribution is a fluid limit for the 
queueing model we introduce, wherein each user picks his time of arrival from a distribution. Thus, 
the inter- arrival times are not independent, and the arrival process need not be a renewal process 
in general. Functional strong law of large numbers approximation to the queue length process, the 
busy time and the virtual waiting time process at each queue is derived. Also of interest would be 
a diffusion limit (via the functional central limit theorem) for the various processes of interest in 
this non-standard queueing model. We have made some progress on this, and is on-going work. 

Our second contribution is to take the fluid approximation derived above, and study the associ- 
ated population game wherein each non-atomic user strategically picks a time of arrival, as well as 
a queue it would join. Existence of equilibria in such non-atomic games was established in Schmei- 
dler (1973). We, however, argue its existence (and uniqueness) by construction. The equilibrium 
arrival profile turns out to be a uniform distribution over a time interval that we can determine. 
We also characterize the loss in social welfare due to strategically arriving users, and obtain an 
exact expression for the price of anarchy of the game. 

While there has been a lot of work on studying pricing of queueing service (see Dube and Jain 
(2011), Hassin and Haviv (2003), Mendelson and Whang (1990), Naor (1969)), games of timing 
where the users choose an arrival time strategically are not so well-understood. The earliest such 
work is Glazer and Hassin (1983) in which a discrete population of users choose the time of their 
arrival strategically into an ?/M/l queue, by minimizing the queueing delay. Problems with similar 
motivation have been considered in the transportation literature but they have focused on non- 
queueing theoretic fluid models with delay alone as a cost metric (Lindsey 2004). In contrast, the 
framework of Jain et al. (2011) is more general: Each user has a cost which is a function of the 
waiting time as well as the service completion time of the user (a proxy for the number of users 
who arrive before that user) - a significant motivation for users to arrive early in many scenarios. 
On the other hand, only a fluid approximation of the discrete population model is considered. 

In Section 2, we first develop a path-wise description of the parameters describing the queueing 
network, and fluid limit approximations to these processes. Next, we analyze the strategic arrivals 
game in the fluid setting, for a single arriving population in Section 3, and derive the equilibrium 
arrival distribution and the price of anarchy of this game. In Section 4, we derive the equilibrium 
arrival profile for multiple populations with disparate arrival costs, and show that it is unique. We 
derive the price of anarchy of this game, show that in a special case, it is bounded above by 2. 
In Section 5, we illustrate the difficulty in doing exact equilibrium analysis for a finite population, 
and hence the importance of equilibrium analysis in the fluid limit. We conclude with a summary 
and discussion of further work in Section 6. 

2. The Queueing Network: Model and Fluid Limit 

Consider a queueing network with K single server FIFO nodes in parallel. Each node starts service 
at some fixed time (which could be different from the other nodes), offers service with a finite 
service rate, and operates independently of the other nodes. Each users' time of arrival is an 
i.i.d. random variable with a given distribution and known support such that users can arrive and 
queue up even before service starts. Note that inter-arrival times need not be independent. Service 
times are i.i.d., and independent of the arrival process. A user upon arrival joins one of the queues 
according to a given routing probability. Routing will be assumed independent of the arrival time 
process. We first develop the fluid limits for the queueing model introduced as the population size 
increases to oo. 

Let P) be a probability space, and V K := V K [— T , oo) the space of ^-dimensional "right- 

continuous with left limits", or cadlag processes (see Durrett (2010), Billingsley (1968)). Suppose 
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there are n users arriving at the queueing network. Let : fi — > {1, ■ ■ ■ , K} be a random variable 
such that user i is routed to the ^(w)th node in the network. Thus, p , k = P(£i = k). 

Let Tj : Q — > [—T ,T] be the arrival time of user i, and F the arrival time distribution. Denote 
A n (t) := (A"(t),- ■ ■ ,Ax(t)) G V K , where A^(t) counts the number of arrivals at queue k, i.e., 

n 

A n k {t)--=Y. 1 iT i <t}Mi i =k } , VtG[-T ,T], (1) 

i=l 

where 1{.} denotes the indicator function. Let A n (t) = Ylf=i A™ (t) be the aggregate number of 
arrivals to the network by t. 

Let v\ : O. — > (0, oo) be the service time of arrival i to queue k in the network, independent of T t 
and £j. Let m k be the mean service time, [i k = 1/rrik the service rate and T sk > the service start 

k 

time of queue k. We accelerate the service rate by scaling the service time by n, i.e., v\ = ^- is the 
accelerated service time of user i at queue k. The accelerated or scaled service process of queue k 
is defined as 

S n k (t) :=sup [m G AT | jS? < t - T a , fc } , Vt>T s , fc . (2) 

^ i=l J 

The service vector process is S n (i) := • • • , S%(t))' G 

Let V fe (m) = X]"=i ^ be the service time requirement for m users at queue k. We will call it the 
(cumulative) workload process, and its scaled process description is 

[nt\ 

V k n (t):=J2^i, Vt€[-T ,T\. (3) 

i=l 

The vector cumulative workload process is V"(t) := • • • , V^(t))'. It is easy to see that V k n {t) 

and S k (t) are renewal "inverses" of each other. 

We now develop path-wise functional strong law of large numbers approximations to these 
processes as n — > oo. We will assume that £j,Tj and v\ are mutually independent. Denote M = 
diag(mi,--- ,m K ), p = (p ,i,--- ^o.k)', and t s ,+(t) := ((t - T s>1 ) + , ■ ■ ■ , (t-T SjK ) + )' where := 
xl{j;>o}. The fluid limits for the arrival, service and the workload processes are then given by: 

Theorem 1. As n -»• oo, (£A n (t), £S"(t), V(t + T )) ->• (pF(t),M- 1 t S!+ (t),Ml(t + T )) a.s. 
u.o.c, \/t G [— T , oo), where 1 = (1, ■ ■ ■ , 1) . 

Here, and in the ensuing, u.o.c. denotes "converges uniformly on compact sets". The proof of 
this theorem is omitted, as it uses standard arguments: Convergence of the service and workload 
processes are standard, and follow from the functional strong law of large numbers. The conver- 
gence of the arrival process follows from a generalization of the Glivenko-Cantelli Theorem, using 
independence of the routing and arrival time random variables. 

Now, let Q(t) := (Qi(t),- ■ ■ , Qk^)) G V k , where Qk(t) is the queue length at node k at time t. 
We assume that the queueing network starts empty, so Q(— T ) = 0. The queue length process of 
node k is given by Q k (t) = (A k (t) — S k (t)) + , the non- negative difference between the aggregate num- 
ber of arrivals and the (potential) service process up to time t. Let the amount of time in \F s>k , t] that 
node k spends serving users be called the busy time process, B k (t) = (^j^ k l{Q k (s)>o}ds^ l{t>T sfe }- 
It is easy to see that S k (B k (t)) is the number of arrivals served by time t. Let the scaled queue 
length vector process be given by Q k (t)/n := (A k l (t)/n — S k {B k l (t))) + /n. We can rewrite this in 
vector form as ^Q n (t) = (^A"(t) - pF(t)) - (±S n (B n (t)) - M^B^t)) + (pF(t) - M- 1 t.,+ (t)) + 

M.- 1 (l n (t)-I n (t)) + M _1 I"(t), where B n (t) := (B?(t), ■ ■ ■ , B%(t))' is the busy time process 



3 



vector, l n (t) := (/"(£),••• ,I^(t)) = t S;+ (t) — B™(i) is the idle-time process vector, and := 
(Ii(t), ■■ ■ , is the cumulative idleness process vector, with I k (t) := /_ To l{Qn( s ) =0 }(fe. 

This can be rewritten again as ^Q n (t) = X. n (t) +Y n (t), where 

X n (t) := QA n (t) - pF(t)^ - Qs n (B n (t)) - M^B"^ + [pF(t) - M" 1 ^,^)] 

+M- 1 [I n (t)-r(t)} and (4) 
Y n (t) := M _1 I n (i), (5) 

It can be shown that the process X"(i) satisfies the following functional strong law of large numbers. 

Proposition 1. As n -> oo, X n (i) -»• X(t) := (pF(t) - IvrH^+O)), a.s. «.o.c. Vt € [-T ,oo). 

The proof is in the appendix. We can now establish the fluid limit for the queue length process. 

Theorem 2. (i) The scaled stochastic process vector (-Q n (i), Y"(i)) satisfies the Oblique 
Reflection Mapping Theorem (see Chen and Yao (2001)) and, 

(ii) as n ^ oo ; _(iQ"(t),Y"(t)) -> (Q(t),Y(t)J := (*(X(t)),*(X(*))) a.s. u.o.c.Vt G 
[-T ,oo), w/iere $(X(t)) = X(t) + (X(t)) and = sup_ To < s < t (-X(s))+ is the reflection 

regulator map. 

We now define the virtual waiting time process as W(t) := (Wi(i), • • • , Wjc(i)) = Z(i) — t S) _(t), 
where t Si _(t) = ((t — T Sil )l{ t < Ts 1 j, ■ ■ • , (i — T s .x)l{ t < Ts K }) , and the workload process as Z(t) := 
(Z^t),--- ,Z K (t))' where Z fc (i) ':= T4(^ fe (t)) - B k (t), Vt G [-T ,oo). Here, Vib(A fc (t)) is the total 
work presented to queue k by arrivals up to time t. Thus, the workload process is the amount of 
work remaining after the queue has been busy for B k (t) units of time in [T s>k ,t]. Now, the scaled 
fcth component of W(t) is given by W£(t) = V k n (Al(t)) - B%(t) - (t - T Sik jl {t < Ts k} . Theorem 3 
establishes fluid limits to these processes. 

Theorem 3. Asn^ oo, B n (t) -> B(i) := t, i+ (t) - M*(X(i)) = t s .+(t) - Msup_ To < 5 < t (-X(s)) + 
and W n (t) ->W(t) :=MpF(t) -B(t) -t.,_('t) a.s. u.o.c, Vt G [— T ,oo). 

The proofs can be found in the Appendix. 



3. The Network Concert Queueing Game 

We next address the following question: If the arriving users into a parallel queue network choose 
a time of arrival so as to minimize a cost function that trades off the amount of time spent waiting 
for service against the service completion time (a proxy for the number of users that arrive ahead 
of them), what does the arrival process look like? We consider users choosing mixed strategies, i.e., 
probability distributions over arrival times, and look for the mixed-strategy Nash equilibrium of 
the non-atomic game, derived from the fluid limit in the previous section. 

Suppose the population size is n. We consider cost functions that are a weighted-linear combi- 
nation of the mean waiting time and service completion time. Thus, the expected cost seen by a 
user arriving at time t to queue k is C k {t) = aW k (t) + j3t k , where W k {t) is the expected virtual 
waiting time, and the service completion time t k is easily seen to be t% = t + m k + w k (t), with m k 
the mean service time. We look for symmetric equilibria in the one-shot arrival game, with each 
user having the cost function C k . In general, it is quite difficult to obtain closed form solutions to 
the associated fixed-point problem (we illustrate the methodology in section 5). Thus, we scale the 
population size n to oo, and study the population game associated with the fluid limit derived in 
the previous section. Now, the scaled cost function is C k (t) = aw k (t) + f3t c k ,n . From Theorem 3, we 
then have the limit as C k (t) = aw k {t) + (3t c k , where i c . k = t + w k (t) and w k (t) = m k {X(t) J r ^(X( K t)) — 
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(t - T Stk )l t < Ts k ), with X(t) = F k (t) - /z fc (t - T Stk )l t > Ts k . Here, F k (t) = ^ =1 F Jk (t) denotes the 
aggregate arrival profile to queue k. 

Now, consider N populations of users, with population j users having cost characteristics (ctj,f3j). 
Denote by T s _ k > 0, the time at which queue k starts service. Let Fj k (t) denote the arrival strategy 
of population j at queue k, and F = (Fx, • • • ,F K ) denotes the (aggregate) arrival profile. Denote 
F j = (Fji,l = 1,- ■ • ,K) and F = (F° , j = 1,- ■ • ,N) as the strategy profile. The service completion 
time for a population j user arriving at time t at queue k is given by t^ k = t + W jtk (t), where Wj, k (t) 
is the virtual waiting time. Thus, the cost for a population j user arriving at time t at queue k 
under arrival distribution F is C^ k ^(t) = ajWj^t) + (3j(t + Wj t k (t)). We now define (symmetric) 
mixed strategy Nash equilibrium profiles for the non- atomic/population game. 

Definition 1. A strategy profile F is an equilibrium strategy profile if for each population j, F j is 
a minimizer of the corresponding cost functions C jk at each queue k at every time r in the support 
of F jk (denoted Tj k ), i.e., for any arrival profile G, and Vj, V/c, 

Cjk,F(r)<Cjk,G(t) VreTj, -oo<t<oo. 

In recent literature, these have been called mean field equilibria (Adlakha and Johari 2010). 

The equilibrium condition captures the fact that for each population, the equilibrium profile 
must minimize its cost into any queue at any time. Furthermore, it also implies that all queues 
with a positive flow of population j must have equal cost, i.e., VI, k, Cji iF (t)l{Fji(oo) > 0} = 
Cj k ^(t )l{-Fjfc(oo) > 0}, for all t and t in the support of (the Lebesgue measure corresponding to) 
Fji and F jk respectively. Though it can be established herein, due to space constraints, we will 
just assume that an equilibrium arrival profile does not have any singular continuous components. 
Without loss of generality, we also assume that server 1 starts service at T St x = while other servers 
have a delayed start with T s>i > 0, i ^ 1. For simplicity, assume that the queues 1, ■ • ■ , K start in 
that order. In the rest of this section, we will consider only a single population of users. 

We denote the time of first arrival into queue I by —T j, the time of last arrival into any queue 
by Ti, and the time the last user served departs from queue I by Tfi. The next two Lemmas help 
in finding the equilibrium arrival profile. 

Lemma 1. At equilibrium, all queues finish serving users at the same time instant. 

Proof: For simplicity, consider only two queues. To see that Tfx = Tf 2 , note that at equilibrium, the 
costs at each of the queues must be equal at all times. Assume that Tfx < T f2 . Then a user arriving 
into queue 2 at any time t 6 (Tfx,Tf 2 \ must experience a higher cost than if she had simply joined 
queue 1 (which is now idle). It follows that this arrival profile cannot be an equilibrium. Similarly, 
T f2 i. T S x. Thus, we must have T fl = T f2 . m 
The following fact is intuitively obvious but we give a formal argument. 

Lemma 2. The parallel queue network is never idle at equilibrium. 

Proof: We prove this by contradiction. In light of the fact that the cost of arriving at any of 
the queues is the same, it suffices to prove the assertion in the case of a single queue alone. 
Let T s = 0, the service start time. Let F be such that t* := inf{-T < s < T\^(X(t)) > 0}, 
i.e., t* is the first time that the regulator mapping is positive during the arrival interval, 
implying the queue is idle. This implies that ty(X(t)) = —(F(t*) — fj,t*l^ t *> Q y) > 0. Now, 
let e > 0, and t* — e is just to the left of t*. Then, it follows that, C(t*) = fit* . Consider, 
C(t*) - C(t* - e) = f3t* - ^±^(Q(r - e)) - (3(t* - e). As t* is the first time the queue is empty, it 
follows that Q(t* — e) = (F(t* — e) — ji(t* — e)l{ t *_ e > }). Substituting for Q in the expression above, 
we have C(t*) - C(t* - e) = [3(e) - { -^f 1 (F(t* - e) - fi(t* - e)l {t *_ e > 0} ). Let e -»• 0, and use the fact 
that F has no singularities (and hence is continuous), it follows that C(t*) < C(t*—). This implies 
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that this arrival profile F, cannot be an equilibrium, thus proving the claim. 



It follows from Lemmas 1 and 2 that at equilibrium, with a homogeneous population, the last 
arrivals into any queue should all happen at the same instant, and this time coincides with the 
instant at which the service process catches up with the backlog; that is, Tf t =T t =T. Using the 
above Lemmas, it follows that the cost to a (non-atomic) user arriving at time t as 



C(t) = (a + p) (Af X(t) - t a ,_ (*)) + ptl 



■{a + 0)(p Otl ?®-+T Btl )-ab' 
(a + /3)( P0}K ^+T StK )-at_ 



(6) 



3.1. Arrival Distribution 



Now, let the arrival profile at queue I at equilibrium be F*(t) with support on [— T j,T], and 
define F*(t) := p ^F*{t). Due to space constraints, we note without proof that any equilibrium 
arrival profile F is absolutely continuous. We now derive the equilibrium arrival profile illustrated 
in Figure 1 . Denote 7 = a/ (a + j3) . 

Theorem 4. Let = T s u < T s 2 < • • ■ < T s K . Assume that T s K < 1+ ^ wT ^ , Then, the unique 

l^k=l^k 

equilibrium arrival profile is F* = (F*,- ■ • , where Fj* = ° with support [— T 0th T], where 

and -T 0tl = (1 - i)T 



T = — Jg 1 k s ' k and —T x = (1 — -)T + and the equilibrium routing probabilities are given by 

^k=l 




Proof: Note that the cost function is unbounded as t goes to ±00. Thus, at equilibrium the arrival 
profile must have bounded support. Let the support of the arrival profile to queue I be [— T j,T]. 
Now, at equilibrium, the cost of arriving at queue I is the same at any time in this arrival interval. 
Thus, Ci(T) = Ci(—T 0> i), from which we get 

p j = lMT + T ,). (7) 

Next, the equilibrium expected cost of arrival is the same at any queue and at any time in their 
respective arrival intervals. From Lemma 1, we know that the time of last arrival at any queue is 
the same for all queues. Thus, C ; (T) = C fc (T), for any l,k, and using ^2 t ^ k Po,i = 1 — Po,k, we get 
X^fc/^ T^f +^s,fe — T s .i) = 1 — po.k, rearranging which, we get that the equilibrium probability of 
routing to queue k upon arrival is p , k = — (1 - Ewt Hk{T Stk - T sd )). 

Now, from Lemma 2, we have that Hi(T — T Stk ) = p Q _ k since the population size has 
been normalized to 1 . Substituting for p k , we get T = ^^g 1 A ' fcTs - fc . Now, it follows 
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from equation (7) that — T j = T — ^1. Substituting for T and p j we get — T 0j ; = 

((1 - i)(l + Ef=i M*r a , fc ) + ^ Ef=i which simplifies to -T ,, = (1 - I)T+ ^. 

pi* ft*) 

Finally, equating the cost of arrival at queue I at any time t with that at T 0;J gives (a + j3) l ^ — 

at = aT j, which yields F*(i) = /x;7(i + T j) = Po ^^°'' ) , an equilibrium arrival profile at queue I. 

We now argue uniqueness. First, note that for a given T s j, the terminal service time T is unique. 
Let F be another equilibrium profile with support % for F 4 , where we can take % = (— oo, T]. Now, 
the cost of arriving at T is Cp(T) = (3T = Cp.it) for each t £ %. This is the same as under the 
profile F*. Thus, F l {t)=F*{t) on %C\ [-T 0ii , T]. Now, since F* (-T 0ii ) = and F*(T) =p 0ji , F has 
total measure 1 at T and is absolutely continuous, it follows that F 4 (i) = F*(i) on [— T 0i j,T]. ■ 

Remarks. 1. Note that we assume T s K <T for convenience. Suppose T s ( > fc ;=\ fc a ' fc for some 

£k=iW: 

queue Z G {2, ■ • ■ , K}, then at equilibrium no users would arrive at queues {I,..., K}. 
3.2. Price of Anarchy 

Define the social cost of arrival profile F as J(F) = EfcLi/ Cp k {t)dF k {t). Let J opt denote the 
optimal social cost over all arrival profiles, and J eq (F*) the social cost at equilibrium F* . It is to be 
expected that J eq (F*) will be greater than J opt . The inefficiency of the equilibrium arrival profile 
can be characterized by the price of anarchy (PoA), rj = sup F * Je j^ - , where the supremum is over 
all equilibria. Note that here the equilibrium arrival profile is unique. 

Theorem 5. The price of anarchy of the network concert queueing game is given by 

^1 + Efe=i E/=i ^k^iT s j{T Stk — T s j) + 2E fc= i HkT s ,k^j 

Proof: Let the equilibrium cost at queue I be Ci(t) = c = aT 01 for all t G [— T ./,T]. The equilibrium 

social cost under profile F* is given by J eq = Ek=i / C Fk {t)dF k (t) = cJ2 k=1 J dF k {t) = c(p ,i H h 

Po k) = c Substituting for c, we have J e „ = aT i = j3 flkTs ' k , 

Now, the socially optimal outcome would be for each non-atomic user to arrive just at the instant 
of service, with zero waiting. In this case, the instantaneous cost would be C opt (t) = (3t. Thus, the 
optimal arrival profile is given by 



dF opt (t) = ^2 Vkdt, for T a>l < t < T s , l+1 . 



k=l 



It is straightforward to see that the time of last arrival (and service) is T opt = T = — fc -i 3 ' . 

^k=l ^k 

From this, the optimal social cost can be computed as 
J op t= Pn!tdt+ p(j il + n 2 )tdt + ---+ p(J2n k )tdt, 

= 2\ T2 ^ flk ~^ VkTl k j = — | ( 1 + Yl VkViT s ,i( T s,k ~ T a< {) + 2 VkT s ,k) ■ 

^ fe=l fc=l ' ^l^ l k=lh L k\ fe=l ;=i fe=l / 

Using this along with the expression for J e<? derived above, we get the expression for rj. ■ 



Corollary 1. The price of anarchy n is upper bounded by 2. 
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Proof: We will show that J eq < 2J opt . Consider the difference J eq — 2J opt and simplify the expression 
to obtain J eq - 2J opt = ^/ ^ fefeLi Mfe Yj k =i V-k^k ~ Sf=i V>kT Stk (j2k=i L>>kT s ,k + lj J • Recalling 
that T = — _ ga_ ^ we can re pi ace the last term on the R.H.S. above and simplify to get J eq — 

2J opt = — X]fc=i A*fc ( Ylk=i ^kT s k(T s ,k — T) ) . Now, we know from the statement of Theorem 4 
that T > T S;fc Vfc. Therefore, it follows that J eq < 2J opt . m 
Remarks. 2. It is easy to see that the upper bound is achieved if T* k = 0. This is not surprising, 
as a set of parallel queues that start service at the same instant operate like a single server queue 
with effective service capacity 

3. Surprisingly though, Corollary 1 implies that staggering the start times of the queues can reduce 
the PoA (even though it may increase the social cost), and induce arrival behavior closer to the 
optimum. 

4. As a special case, consider that all queues have the same service rate £ and start at times spaced 
r apart. Then, the PoA expression reduces to 

2 + /xr(JT-l) 

V = r~2 ■ (°) 

l + tiT(K-l)-^f(K2-l) 

An easy lower bound on this expression follows from the fact that 1 + fj,r(K — 1) > 1 + [it{K — 

2 2 

1) — !L ^-(K 2 — 1), which after simple algebra (and using some elementary facts) yields 2 > rj > 
1 + 1+ ^-d > 4/3- 

4. The Network Concert Game with Multiple Populations 

We now consider multiple populations of users arriving at a K parallel queueing network. Let 
J\f = {l,--- ,A^} be the set of arriving populations, each with risk characteristic (ai,/3i). Denote 
7i = a,i/(a.i + Pi). Let the service start times be = T S;1 < ■ • ■ < T StK with mean service rates \x^. 
Recall, from Section 3, that the (fluid limit of the) expected cost of arrival for a population i user 
to queue k at time t is given by C.^ k {t) = (a, + Pi)W iik (t) + fat, which as earlier, is constant over 
the arrival interval, and same across all the queues in the network. 



1 X 1 
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MK 

Figure 2 Arrivals from multiple populations into multiple queues. 
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The following Lemma shows an interesting self-organization property at equilibrium. 

Lemma 3. Suppose that < 72 • • • < 7at. Then, at equilibrium population i users arrive before 
population j users for i <j. Furthermore, the arrivals are over disjoint intervals, without any gaps. 

Proof: Let T s ^ k = 0, for all queues k. The general case will follow easily from the ensuing argument. 
First note that there can be no gaps in any equilibrium arrival profile, F k = ^2^ =1 F, Lk . If there 
were, then, any arriving non-atomic user right after the gap can arbitrarily improve its cost by 
arriving just before such a gap, implying this arrival profile is not in equilibrium. Now, the cost of 
arriving at queue k is constant, for a given population i over the arrival interval. Differentiating 
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Figure 3 Two parallel queues, and two arriving populations with 71 < 72. Population 1 arrives over [— To,i,Ti] 
at queue 1, and over [— Tb,2,Ti] at queue 2. However, population 1 need not be served completely until 
time ti at either queue. Population 2 arrives over [Ti,T 2 ] and is completely served at time T 2 . 

Ci,k(t), we have = (a* + — Solving the equation for f i<k , the arrival density, we 

have f itk (t) =Hkli- 

Now, let (ti,t 3 ) be an arbitrary interval, and suppose that t 1 < t 2 < t 3 , such that some 
population j users arrive in (ti,t 2 ] and only population i users arrive in (t 2 ,t 3 ). Consider the 
cost of arrival for population j, Cj. k (t) = (aj + ~ a jt-, f° r t G (t±,t 3 ). As (ti,t 2 ] is in 

the support of F lik , it follows that the cost of arrival is constant over this interval, and it can 
be evaluated at t 2 . Now, let e > be small enough so that t,t + e G (t 2 ,t 3 ). Evaluating the 
cost of arrival at these points and taking the difference of the resulting expressions we obtain 
C 3ik (t + e) - C j)k (t) = [a, + pj) ^^i^C+^-^i^.'-W ^ _ a . e . By assumption, there are only 
arrivals from population i in the sub-interval (t 2 ,t 3 ), and it follows that F^ k (t + e) = F^ k (t) for all 
I / i. This implies that C jtk (t + e) - C jtk (t) = (a rf + (F '- fc(t+£ ^ f '- fc(t)) - a e. Divide through by 

e and let e — > to obtain C' jk (t) = (<x,- + /3 3 ) — otj, where fi ik (t) is the density of the arrival 
profile F iik (t), which was shown to be fi. k (t) = fi k "fi, for t G (t 2 ,t 3 ) C SuppF j fe . Substituting for 
it follows that C j k (t) = (<x, + /3j)(7i — 7j)- By assumption, 7, < 7^, so that C ] k (t) < 0. This implies 
that the cost of arrival for population j is strictly decreasing over the interval (t 2 ,t 3 ), and it must 
be less than Cj, k (t 2 ). Clearly, (ti,t 2 ] cannot be in the support of Fj. k in equilibrium. This implies 
that population j cannot arrive before population i, if i < j. m 

4.1. Arrival Distribution 

Denote by — T 0jfc , the time of first arrival into queue k, and T := — T 01 , the time of the very first 
arrival to the network. Then, from Lemma 3, users from population i arrive in the interval [Tj_i,Tj]. 
Let Ti denote the time the last user of population i is served, and To = 0. Obviously, Ti<Ti, with 
equality only if i = N since at equilibrium the last (non-atomic) user to arrive into the network 
has no incentive to arrive before his service time. Figure 3 provides a simple illustration of this 
phenomenon, for two arriving populations at two parallel nodes. 
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Define J t = {1 < k < K : T s , k G [Ti_i,T;]}. Then, population i users are served by the queues 
Ji = Uj = i Jji where queues J l first serve population i before any other. Consider / G Ji with aggre- 
gate arrival profile Fi(t) = Yln=i F n ,i(t) , where by Lemma 3, F n j has support [T„_i,T n ]. Note that 
J2iej Pi, 1 = Sj=i J2kej Pi,k = 1- We can now derive the equilibrium arrival profile for each popu- 
lation. 

Theorem 6. Suppose ji < 7»+i, V? and T s>k < T s . fc+1; V/c. Then, the unique equilibrium arrival 
profile for population i at queue k G «/,, j < i, is dF* k {t) = jifi k , Vi G [Tj_!,Tj] ; and queue 

I G Ji is dF-^t) = ji^i yt G [-T 0il ,Ti] where T N = N 1 [N + YliLi Ylkej ■ VkT s , k ) , and 



Tj_i = Ti — /or i = 1, ■ ■ ■ , iV — 1 ; k& Jj and j < i. For I G J», £/ie arrival interval is [— T 0i /, Tj] ; 
w/iere -T ol = Ti~ 

Furthermore, equilibrium routing probability for I G J { ,i>l is 



Pi,i = ^l-^ (i ~ E E Vk(T s ,i - T s . k )) , 

2-~i3=i l^ke.Ji ^ k ^ j=i fee./, ' 



(9) 



and for k<E Jj, j < i, and i > 2 is 



!i f 1 - E tt(E^) - E^>* - r -.«)) • ( 10 ) 



Proof: Note that population i is served by queues Ji,l <i. The expected cost for a population i 
user to arrive at queue k G is C iik (t) = (c^ + (3i)W k (t) + /3jt for i G [Tj_!,Tj] for k £ J h l <i , and 



for t G [-To,*,!}] for A; G J t . Recall that, F fc (t) = Ej=i- F j,*(*)> where has support [-Tq^T;] 

and F jk (t) has support [Tj_i,2}] for each j > i. The virtual waiting time process at queue k is given 
b y W k (t) = j-F k (t)-(t-T s . k ). 

Now, note that at equilibrium, the expected cost for a population i user to arrive at any queues 
k,l G J l has to be the same. Thus, from C uk {T,i) = C u i(Ti), we get that 

^ + T S;fe = ^+T M . (11) 
Mfc l±i 

Let p < q < i be two populations that arrive prior to population i. Then, for any k G J p and to G J q , 
k <m and at equilibrium the expected cost of arriving into queues k and to for a population i user 
has to be the same. Thus, from C uk {T,i) = Cj iTO (Tj), we get 

— (Pp.fc +Pp+l,fc H hPi,fc)+T Si fc = — (p g , m +Pg+l,m H hPi.m) + ^,m- (12) 

Mfc Mm 



First, consider p < q. Then, for a population q user, C Qtk (T q ) = C q ^ m {T q ) for queues fc, m as above, 
hich yields j^{p P ,k + P 
have, by induction that 



which yields j^(p P ,k +P P +i,k H r-Pi.k) +T Sifc = j^(p q , m ) + T S:in . Substituting this into (12) we 



Pisn V/c G J p , m&J q , p<q<i. (13) 

Mm Mfc 

Now consider p = q. Then, for any k, I G «7p we have C iik (Ti) = C M (Ti), implying -^(p p , k H h 

Pi,*) + ^ = i(p Pil + • • • +p M ) + T,,,. It follows from (11) that p -^+T s ^ k = p -f+ T,,,. Thus, by 
induction, we have 

PLi = ?L* \/k,l€J p , p<i. (14) 
Mi Mfe 
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Next, let population j < i, and k G Jj and I G Ji are two queues that serve population i. Once again 
by the equilibrium conditions we have C itk (Ti) = C i j(T i ). Simplifying the expression we obtain 

i-l 

Pi.fc = — Pi,i + Vk(T s ,i - T s , k ) - y^p p .k- (15) 

p=i 

Now, we have Ep=i Yl m eJ p Pi,™ = 1- Consider a j < i and a k G Jj for i > 2. It follows that 
Ep=i, P ^ E me j p Pi,m + Ej e j^fcPM = 1 - Pi.fc- Substituting for p 4 , m and p M in terms of p i>k from 
(13), (14) and (15), we get p l , k in (10). Now, for an I G J, for any i > 1, using (11) and (15) and 
substituting for p iik and p i>m (respectively) in terms of p itl in Ej=i ^2 meJ .Pi, m + EfceJ^^zRfc = 
1-Pi,i, we get Pi,; in (9). 

We now derive the equilibrium arrival distributions for each population to each serving queue. 
First, recall that the cost function for population i at queue k G Jj,j < i, is given by C itk (t) = 
(ai + PA ( —F k (t) + T sk ) — V£ G [Tj_ 1; . Differentiating this and recalling that at equilibrium 

the cost is constant over the arrival interval, and that F k (t) = E p =j PpM + Fi,k(t) , we have dF ifk (t) = 
7i/ifc Vi G [Ti_i,Ti]. Now, for queue k G J,, the users arrive over the interval [— To^Tj]. Again, 
differentiating the cost function C ijk (t), we have dF itk (t) = 7,/^ Vi G [— T 0;fe ,Tj]. 

Finally, we can derive the support of these distributions by backward recursion. Note that 
for population N, \/k G Jn Hk(T N — ^s,fc) = Pnm- Substituting for from (11), we get Tjv = 

(n + 52j =1 E fc6Jj ^ T -fe) / (EjLi E feeJj . ^) • 

Next, at equilibrium, we must have C itk (Ti) = Ci^T^) \/k G J 3 ,j < i, from which we get = 
?i — J ^ L . Note that we need to use j < i in order to obtain the recursive definition of T i _ 1 , since 
Ci ik (t) < Cij(t) on [Tj_i, — T 0j ;], for I G J^; that is, there are no arrivals from population i at queue 
/ G Ji on this sub- interval. Finally, population i users arrive at queue k G J, in the interval [— T 0ji , Tj]. 
Thus, at equilibrium we must have C iyk (— T 0jfe ) = (7^(1$), from which we obtain — T . fe = T; — 

The proof of uniqueness now follows that of Theorem 4 and we omit it for brevity. ■ 

Remarks. 1. Theorem 6 shows that at equilibrium the arriving populations self-organize in ascend- 
ing order of % and there are no gaps in the arrival profile. Further, the queues operate at full 
capacity till all arriving users have been served. 

4.2. Price of Anarchy 

We now compute the price of anarchy for the multiple populations case. Define the 
social cost at equilibrium with arrival profile F, as J(F) = Eili^(-^)> where J eq ^ = 

E keJj _ ItL outwit) + v, , j% oi cmuifjU). ^ 

At equilibrium, the cost of arrival for population i is uniform over the support of its 
arrival profile, and moreover is the same at all queues that the population chooses to 
arrive at. Thus, C it i(t) = c i: some constant. Then, if F is an equilibrium arrival pro- 
file j e9i4 = a (E}= 1 iEfcgj j /5_ 1 ^i,fc(0 + Ei eJi /TT OiI ^i,i(*)) = Ci£5=i£fc eJj .PD,fc = ^ since 

Ej=i Efeej-Po.fc = 1- The aggregate equilibrium social cost is given by J eq = Yl?=i J e q ,i = EiLi c *- 
Let ei(i) denote the "first" queue in J t , i.e., the queue with the earliest service start time T s j, 
I G Ji. At equilibrium we have C i>ei ^(Ti) = {a, + A)( P '' ei(l) + T s<ei ^) - a{Fi = c u where, Pi, ei (i) 
is the fraction of population i users routed to queue ei(i). Now, let ei(l) be the very first queue 
to start service (and serve population 1 first). Without loss of generality, let T S)ei (i) = 0. For 
population i the cost of arrival at any queue in Ji is the same over the arrival interval, and it 
follows that Ci, ei{i) (Ti) = C iiei(1) (Tj, which implies that P -^+T s . ei(l) = Y! 3=1 Further, 
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using the recursive definition of T,, T, = T N — r N ... Pj ' ei(1) . Substituting for P '' eiW + T S e ,a) and 
Ti in Ci(Ti), we obtain 

J ^ = t4Ut^P^ -* lW T.,. lW - (V E ^-)). (16) 

j = l \7» \ j- =1 Pei(l) / \ j=»+l '.J^eiW / / 

Now, from Theorem 6 we have an expression for T N in terms of the exogeneous parameters of the 
network. Substituting that into (16) we obtain an expression for J eq that is, unfortunately, quite 
messy for the general case. Below, we illustrate this expression for a much simpler special case. 

Next, we note that the optimal arrival profile would be for each non-atomic user to arrive right 
at the instant of service. In this case, there is no waiting time and the cost of arrival at time 
t is ^t, for a user of population i. Let tt : N — > N be a permutation on the set of populations 
such that /#7r(i) > • • • > P-k(n)- In the optimal arrival profile populations should arrive in the order 
7r(l),7r(2),---,7r(iV)-_ 

A key observation is that since the sizeof each population is the same, the set of queues Ji that 
serve population i at equilibrium, will now serve population vr(z). Let J* be the set of queues that 
serve population in the optimal arrival profile. This is because there are no gaps in the optimal 
and equilibrium arrival profiles. Thus, for given queue start time times, T s fe , if population i in the 
equilibrium arrival profile is replaced by population 7r(«) , the set of queues that served population 
i will now serve population vr(i), whose users now arrive over [T i _i,T i ], which is the equilibrium 
arrival interval for population i. 

Thus, the optimal social cost is 



J opt 



N N , i-1 s 

E - w<o = 2 £ ( £ S "*(m a - ^-i) 2 ) + E nim 2 - T h) ) . ( 17 ) 

i=i i=i ^ j=i feeJ,- ;eJi ' 



where = — ^ i^eJj Pfc ^ ano i - g p rec i se iy the time a t which population i finishes service 

at equilibrium. We can substitute for T, in (17), which yields a fairly complicated expression for 
J op t and the price of anarchy, n = J eq /J pt, in terms of the exogeneous parameters. 

To get some insight into the price of anarchy, rj, we illustrate it for a special case where the 
service rate offered by every queue is the same fx > and the start time of the kth queue is r(k — 1), 
for some r > 0. Let the number of queues that serve the first I populations to arrive be Ki. Then, 
the instant at which population ir(l) (or population I, at equilibrium) is served out is given by 

Ti = l+ ^k=i t * T ( k _ l +^r K i( K i N t e that Ki is unknown a priori, but can be easily calculated. 
Suppose [it < 1, and relax K x G [l,K] to take real values. Then, the following Lemma shows that 
Ti is a convex function of Ki. The optimal value of K t then is the nearest integer to the optimal 
real value computed. Let [x] denote the nearest integer to the real number x. 

Figure 4 plots 7} as a function of Ki, the number of queues that serve population I. Note that 
Ti is a convex function of Ki and has a minima. We establish this fact formally in Lemma 4. 

Lemma 4. Suppose fir < 1. Then, T t is a convex function of K t G (1,-K"]. Further, it achieves a 
minimum at Kt = 



Proof: From Theorem 6 we have Ti(k) = + |(fe — 1), for G (1,-K"]. Differentiating with respect 
to A; we obtain dT Q^ = —j^t + f , which yields a critical point k* = ^Jllj \it (only the positive 

value is feasible). Further, the second derivative yields = > Vfce (1,-K"]. Thus, T;(fc) 

is convex for real k and achieves its minimum at = [k*]. m 
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Figure 4 Terminal arrival time Ti as a function of Ki, the number of queues that service population I, plotted 
for 1 = 1,7, 14, and for /it = 0.1 and /i = 1.0. 



Remarks. 2. Lemma 4 shows that the number of queues that will serve population I, Ki, is 
proportional to \fl, when /j,t < 1. 

3. If (I — 1) < fir < I, then, there will be more than one queue that serves population I, and at most 
one that serves all populations with index less than I. In this case as well, the number of queues 
that serve population I can be found by solving a convex optimization problem. 

Now, we characterize the price of anarchy in the special case when every queue in the network 
serves at the same rate, and service start times are equi-spaces. 

Theorem 7. Suppose that each queue offers the same service rate [i > 0, and queue k starts service 
at time r(k — 1) with r > 0. Then, the price of anarchy i] is 

= H(i-£)E£itt« + Ei=iA} <2 

Proof: The expression for rj follows by substituting, for any queue I = !,■•■ ,K, \xi = fi and T s j = 
t(1 — 1) (i.e., the queue I starts service at time t(1 — 1)), in (16) and (17), using Lemma 4 and 
taking K t m y/2l//j,T. The expression in the statement then follows after some elementary algebra 
and is omitted for brevity. 

To see that rj is upper-bounded by 2, first consider N = 3. The expression for J opt reduces to 



+?4/!(t+3>^>H 



J eq is simply f ^1 - ^ J ^Li a *(i) + I ELi Ar(0 = I ( 1 _ E*=i + 1 ELi ft- Using these 



expressions, we evaluate 2 J opt — J e . 



'opt ° eq 

3 
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The first term on the right hand side is > 0, since 73 < 1 and on > for all i. The terms 
after j3 2 and j3 3 can easily be verified to be non- negative. The only term left to consider is the 
one after /3i . Denote S = | + ^ — | . Multiplying and dividing by ^/2//ir we have 

S = ^/ST^JL + I _ fy^Q. Let x := y/2/ fir. Then, it can be seen that Sx = (fx 2 - fx + |). 
Suppose that <5x < 0. That is, (after factoring the LHS) (8x — l)(x — 1) < 0. This implies either 
(8x — 1) > and (x — 1) < 0, which contradicts the fact that x = -y/2/^r > 1 when /it < 1; 
or (8x — 1) < and (x — 1) > which is impossible. Therefore, it cannot be the case that 
(8x — l)(x — 1) < 0, thus proving that 2 > J eq / ' J opt . It can also be checked (after some tedious 
algebra) that the terms after f3t, for I > 3, are larger than those after /3 3 and so it is possible to use 
the same argument for an arbitrary number of arriving populations, N. m 



5. Exact equilibrium analysis: An example with two users 

A natural question is whether equilibria can be found in a finite population strategic arrival game, 
and how close the non-atomic equilibrium is to such an outcome. It turns out that finite population 
equilibrium analysis is not malleable to a tractable analysis in general, and the resulting expressions 
can be solved exactly only in some special cases. We illustrate the methodology with two FIFO 
queues serving in parallel, with two arriving users, with service rates fi k , service start times T Si i = 
T s 2 = 0. We derive the exact equilibrium arrival distribution, and show that it is unique. The 
extension to more than two users cannot be solved in closed form. Finite population analysis for 
a single server queue can be found in Juneja and Shimkin (2011), which also makes the same 
observation. 

Let the two users be indexed by i £ {1,2}, and let Tj be the arrival time of user i. Assume 
that the distribution function F t of T l is absolutely continuous. Let = k G {1,2} be a routing 
random variable, such that £i(oo,t) = k implies that user i at time t is routed to queue k. Let 
Pi,k(t) '■= P(£i(t) = k) be the probability of user i being routed to queue k at time t. Let Q l k {t) 
be the number of other arrivals that user i observes in queue k at time t, and let A l k (t) denote 
the aggregate number of arrivals, other than the user i, to queue k queue by time t, and let S k (t) 
denote the cumulative number of (potential) service completions, at queue k, up to time t. 

As noted before, the path-wise description of the queue length process is given by Q\(t) = 
(A l k (t) — S k (t)) + , t G M, i G {1, 2} and k £ {1,2}. We also make the assumption that the routing, 
arrival and service processes are mutually independent. We denote by —i, the user j / i. The 
following proposition describes the dynamics of the expected queue length, Q\(t). 

Proposition 2. Q l k (t + dt) = Q l k (t) + Pk (t)f^(t)dt - /i fe (l - P kfi (t))dtl {t > 0} Vie {1,2} and k e 
{1,2}, where, /-,(•) is the density function of the arrival time of the user other than user i and 
Pk,o{t) is the probability that the queue k is empty at time t, i.e., Ph,o(t) = P(Q k (t) = 0). 

Proof: It is easy to see that Q\ (t + dt) = Q\ (t) + E[A{ (t + dt) - A\ (t)]-E [D k (t + dt) - D k (t)]l {t > 0} . 
Here, D k (t) is the number of actual service completions by time t and K[A k (t + dt) — A k {t)} is the 
expected number of users other than i who might arrive in the interval [t,t + dt\. The expectation 
of user —i arriving in an infinitesimal time interval is p k (t)f-i(t)dt. The expected number of service 
completions in the interval [t,t + dt] is given simply by fi k (l — P(Q k {t) = 0))dt. The expression for 
Ql(t) follows by substitution. ■ 

The mean virtual waiting time of user i at queue k at time t is given by W k {t) = ^ — il{ t<0 }. 
Note that an arrival at time t < 0, would have to wait for t units of time before service commences, 
explaining the presence of the term tl{ t <o}- 

Now, users choose a mixed strategy over the arrival interval and the routing random variable. 
Thus, the strategy space of the game is C b x [0, l] 2 , where C b is the space of non-decreasing and 
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absolutely continuous functions with support in R, and [0, l] 2 is the set that the routing probabilities 
take values in. Thus, user i chooses the tuple (Fi,pi)(t), Vt £ M, where p,(i) = (pi,i(t),p2,i(t)) is 
a vector of probabilities at time t. Thus, the choice of Pi(t) must satisfy the constraint + 
P2,i(t) = 1. We designate F = (Fi,F 2 ) as an arrival profile and P = (pi,P2) as a routing profile of 
the game. We are interested in symmetric equilibria in this one-shot arrival game, such that F± = F 2 
and p! = p 2 . For brevity, we drop the superscripts from Q\ and A\, as the definition should be 
clear from the context. 

Now, as before, the expected cost of arriving at queue k is a weighted sum of the waiting time 
and the time at which the user arrives, which yields C k {t) = (a + (3) (j^f^- — *l{t<o}) + Pt- Note 
that the equilibrium arrival profile will have some finite support [—T , k ,T k ] for queue k since the 
expected cost is increasing in both t and —t (since there is only one other user, the expected queue 
length is bounded by 1). Furthermore, the expected cost of arrival must be the same at either 
queue. If this were not the case, then an arriving user could improve its cost by choosing to arrive 
at a queue with a lower cost. We are interested in symmetric equilibria for which the arrival interval 
must be the same at either queue. Let this interval be [— T ,T], where — T and T are determined 
in equilibrium. 

Theorem 8. The equilibrium profile, (F*,P*), of the strategic arrivals game with two users and 
two queues is given by 



and p* (t) 



7(^1+^2) t€[-T ,0] 

7(^1+^2) - MiA,o(i) - /W 2J P 2 ,o(i) t € (0,T], 



OnW t€[-T ,0] 

Mi 1/1, , 1 r , \ M1M2(M2-Ml) gt + c lf\ T] 

^q^y + (,!{,=!} - ±{i=2}J ( M1+M ) /(t ) (S+j8) ' tG i U ' J J' 



where 7 = a/(a + p), P ifi (t) = 1 - w(/3 j;° T(,) and 
The proof can be found in the appendix. 

Remarks. 1. Note that the general case of K parallel queues serving n users is not as simple as 
the result above. The network state dynamics are determined by a set of K coupled differential 
equations, that are in general quite difficult to solve. Instead, using a fluid approximation reduces 
the complexity of the problem, by allowing one to replace the differential equations by simple linear 
equations. 

2. The fluid analysis does lose some accuracy, however, for small numbers of arrivals since it 
suggests that queues can never be idle at equilibrium, but for a large number of users it still 
captures the essential features of the strategic arrivals game. 



6. Conclusions 

In this paper, we have presented three results. First, we have developed large population fluid 
approximations to various processes of interest in a parallel queueing network where the arriving 
users choose a time of arrival from an arbitrary distribution function. We believe these are entirely 
new results and should be of independent interest. Second, using this framework, we then studied 
the network concert queueing game in the large population regime. We proved the existence and 
uniqueness of the non-atomic equilibrium arrival profile, both in the case of a homogeneous popu- 
lation of users, as well as heterogeneous populations with disparate cost characteristics. In either 
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case, we also characterized the price of anarchy of the game, due to strategic arrivals. Third, we 
demonstrated the methodology for finite population analysis, by analyzing a simple instance with 
two strategic users arriving at a two queue network, and deriving the equilibrium arrival profile. 

The queueing model that we have introduced in this paper is of relevance in several settings 
including transportation networks, data center network traffic, etc. Thus, it would be useful to 
understand further the various stochastic processes. For example, the FSLLN/fluid limit analysis 
shows that at equilibrium, no queue is ever idle. This, however, cannot be true in the case of a 
finite population, where, as we have seen in Section 5, there is a positive probability of the queue 
being idle during the arrival interval. Thus, we must derive better approximations to the arrival, 
queue- length and waiting-time processes. One way would be to derive diffusion limits by developing 
functional central limit theorems (FCLT) for the queueing system model we introduced. This is a 
current line of our research. In particular, we have been able to establish that the diffusion limiting 
process to the queue-length in a single server queue is combination of a Brownian motion and a 
Brownian bridge, where the weak convergence has been established in Skorokhod's Mi topology. 

Finally, the alternative queueing system model we have introduced in this paper may involve 
a general queueing network. In such a setting, it would be useful to develop the fluid and diffu- 
sion limits for the various processes of interest, and to establish the set of (non-atomic) strategic 
equilibria that result. We are currently working towards this goal. Our hope is that the framework 
that we have introduced would be of greater relevance for some scenarios, as well as more tractable 
than the GI/G/1 models in standard queueing theory. 

Appendix 

We first state two Lemmas that are useful in proving Theorem 1, and are also useful below. 

LEMMA 5. Let A%(t), \/k, be as defined in (1), where n is the population size, and p = 
(Po,n-" ,Po,k)'- Then, A n (t):=^-^F(t) a.s. u.o.c. Vt G [-T ,T], asn^oo. 

Lemma 6. Let (j;S%(t),V£(t + T )J be as defined in (2) and (3), where ke{l,--- ,K} and t G 
[— T ,oo). Then, asn^-co, 

Qs"(t),V"(t + T )^(S(t),V(t)):=(M- 1 t s , + (t),Ml(t + T )) a.s. u.o.c. Vt€[-T ,oo), 

where M := diag(m\, - • • ,m K ) is a diagonal matrix of the mean service times at each node, 
t s ,+ (t):=((t-T sA ))l {t > Ts l} ,--- ,{t-T StK )l {t > Ts K} )' and 1 = (1, ■ • ■ , 1)'. 

Both Lemmas above can be proved easily using the Strong Law of Large Numbers, and their 
proofs are omitted due to space constraints. 

Proof of Proposition 1 

Proof: (Proposition 1) In order to establish a functional strong law of large numbers result for (4) 
we first require the following lemma relating the processes := ^ f T fc l{Q£( s ) =0 }ds^ 1{*>t s k } 

and I n (t) := l {Q n (s)=0} ds. 

Lemma 7. Let I%(t) and /£(<), the kth components ofI n (t) and l n (t), be elements ofV. Then, 
as n-> oo, |J£(t)-i£(t)|->0 a.s. u.o.c. Vi G [—To, oo). Thus, \l n (t) - l n (t)\ -»• 0, a.s. u.o.c. Vt€ 
[-T ,oo). 

The proof of Lemma 7 follows directly from the following result. 
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LEMMA 8. Let {Q,,F,P) be a probability space. F(t) is a distribution function of a random variable 
T on this space, with support [S,T] C R. Assume that F(t) is absolutely continuous. Suppose 
T X ,T 2 , ■ ■ ■ ,T n are n I.I.D. samples drawn from T ■ Define := inf{Ti,T 2 , • • • T n } as the value of 
the smallest sample. Then, it follows that, \. S a.s. asn— >oo. 

Proof: We will prove this in the case of a uniformly distributed random variable, on [0, 1]. Let U(t) 
be the distribution function of the standard uniform random variable, and let F(t) = U{t). The 
general case then follows by making use of a transformation of the uniform random variable, since 
F(t) is assumed to be absolutely continuous. Fix e > 0. Consider the event, E n := {uj : T[ n ' > e}. 
The measure of this event is given by, P(E n ) = P(T 1 ( ™ ) > e) = P(m£{T u --- ,T n } > e). Since the 
samples are I.I.D. , it follows easily that, P(E n ) = [P(7\ > e)]" = [1 -F(e)] n . Since F(t) is absolutely 
continuous, it follows that, Yl™=i P(En) < oo. By the First Borel- Cantelli Lemma, it follows that 
P(T 1 ( ™ ) > e i.o.) = 0. This implies that T 1 (n) 15 = a.s.. m 
Proof: (Lemma 7) Let r > 0. As the queue is non empty after the very first arrival to the node, 
we have P k l (t) = (/ T <„) l {Q n (s)=0} ds)l {t > Ts>fc }. It is easy to see that I%(t) < J£(i) Vt G [-T ,t\. 

T (n) j,(n) 

Also, J£(t) > 4"(t) - f_% l {Q ^ {s)=0} ds, Vt G [-T ,r]. It follows that f_% l {Q ^ s)=0} ds > %(t) - 
4n(t) -°- 

The conclusion follows on [-T ,t], by noting that Qjj(a) = Vs G [-T ,T™] and applying 
Lemma 8. Since r is arbitrary, the lemma is proved. ■ 
Now, we can proceed to prove Lemma 1, and we analyze the claim component- wise, since 
the processes at each node are statistically independent. The result follows by applying 
Lemmas 5, 6 and 7 to (4). First, note that B%(t) < t. Thus, by the Random Time Change 
Theorem (Theorem 5.5, Chen and Yao (2001)) and Lemma 6 it follows that -S^(B^(t)) — 
li k B^(t) — > 0, a.s. u.o.c. as n — > oo Vt G [—T , oo). By Lemma 5 we have ^A k (t) — p , k F(t) — > 0, 
a.s. u.o.c. as n — > oo \/t G [— T ,oo). Applying these results and Lemma 7 to (4) we have 
X%(t) ->■ X k (t) := (p ,kF(t) - fi k (t - T sM )l {t > Ts k} ) a.s. u.o.c. as n -)• oo. It follows that 
X"(t) ^ (pF(t) -M~ 1 t S!+ (t)), a.s. u.o.c, as n^'oo, VtG [-T , oo). ■ 

Proof of Theorem 2 

Proof: Recall that ±Q n (t) := X n (t) + Y n (t), where X™ and Y™ are defined in (4) and (5), respec- 
tively. Note that if™ we defined Y n (t) := l n (t) = t S)+ (t) - B n (t), the Oblique Reflection Mapping 
Theorem (Theorem 7.2, Chen and Yao (2001)) would not be satisfied, since this process could be 
zero even when Q™(t) is zero. To see this, note that if is the time of the first arrival to the 
network then, Vt G [-T ,T 1 (n) ], P(t) and Q n (i) would be zero, violating the Oblique Reflection 
Mapping Theorem. 

It is a simple exercise to verify that Theorem 7.2 of Chen and Yao (2001) is satisfied, in the case 
of a parallel node network, with Y n (i) = M _1 I"(t): The zero matrix P is trivially a M-matrix. 
By definition, we have Q n (t) > 0, Vt G [— T ,oo). Y n (t) is a non-decreasing if-dimensional process 
that only grows when every component of Q n (t) is zero. 

This implies, (£Q"(t), Y n (*)) = ($(X n (t)), *(X n (t))). The reflection regulator map, *(•), 
is Lipschitz continuous under the uniform metric (Theorem 7.2, Chen and Yao (2001)). By 
the Continuous Mapping Theorem and Lemma 1 it follows that ($(X"(t)), \l/(X™(i))) — > 
($(X(i)),tf(X(t))), a.s. u.o.c. as n^oo, VtG [-T , oo). ■ 

Proof of Theorem 3 

Proof: We prove the Theorem by treating the busy time and virtual waiting time processes sepa- 
rately. The fluid limit of the busy time process is derived in the following Lemma. 
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Lemma 9. Let B™ := (£",••• ,B%)' be an element of V K . Then as n ->• oo B"(t) ->• B(i) := 
t S)+ (i) - M*(X(i)) = t S;+ (i) - Msup_ T() < s <J-X(s)] + u.o.c. a.s., Vi G [-T ,oo), w/iere, t Si+ (i) = 
( i:l {t>T s ,i}r-- .^{t^K})' and M = diag(m 1 ,--- ,m K ). 

Proof: By definition, we have, B n (i) = t s + (t) — I n (i). Adding and subtracting the vector pro- 
cess I n (i) and noting that Y n (t) = M _1 P(t) we have B"(i) = t 8)+ (i) - MY"(t) + - P(t). 
Using Lemma 7 from the Appendix and Theorem 2 it follows that as n — > oo, B n (i) — >■ t 8i+ (t) — 
Mtf(X(t))a.s. M.O.C., Vt€[-T ,oo). ■ 
Next, we derive the fluid limit of the virtual waiting time process in the following Lemma. 

Lemma 10. Let W" = (W?, ■ ■ ■ ,W£)' eV K . Then asn^oo W n (t) ->■ W(i) := MpF(t) - B(i) - 
t s _(t) a.s. u.o.c, yt G [— T , oo), w/iere t s _(i) = {(t - T 8il )l {t < Ta u} , ■ ■ ■ , (t - T s , K )l {t < Ts k} )' , 
P = (Po,ir-- ,Po,j{-)' andM = diag(m 1 ,--- ,m K ). 

Proof: The theorem follows by an application of Lemma 1, the Random Time Change The- 
orem (Theorem 5.5, Chen and Yao (2001)) and Lemma 3. We define the following vector for 
notational convenience. Let V(A(t)) := (V^A^t)), ■ ■ ■ ,V K (A K (t))) The fluid-scaled version 
of the virtual waiting time process is given by W n (t) = V n (A n (t)) — B n (£) — t s ,_(i). First 
note that by Lemma 6 and the Random Time Change Theorem \" n (A n (t)) — M-A n (t) — > 
u.o.c. a.s. as n — > oo, Vt G [— T ,oo). Thus, centering the process ~V n (A n (t)) we get W"(t) = 
V n (A n (t)) - M±A n (t) + M±A n (t) - B n (t) - t.,_(t). Applying Lemma 5, Lemma 3 and the 
comment above we have W™(t) — > MpF(i) — B(t) — t s _(i). Substituting for B(t) we get 
W(t) = MpF(t) - (t.,+ (t) - Mtt(X(*))) - t.,_(t) = MQ(t) - t.,_(t). 



Proof of Theorem 8 

Proof: Recall that C,(£) = c, a constant, Vi G {1,2}. Noting that that expected queue length at 
time — T is zero, it is easy to see that c = aT . It follows that C i (t) = 0. Thus, solving for Pi(t)f(t) 
we obtain 

7/ii t€[-T 0> 0] 
Tft-ft^oW tG(0,T]. 



Pi(t)/(t) = 

Using the fact that Pi(t) + p 2 (i) = 1, we solve for Pi(t) and to obtain 

f osfe ^[-T 0> 0] 



Pi(t) 



(Ml+M+2) + " (Ml+M2)/W (^) tG ( U > J J- 



Thus, it can be seen that the probability of being routed to queue i (in equilibrium) is constant 
before service commences, and is time dependent afterwards. The time dependence is determined 
by the expected idle time of the queue, as can be seen by solving for f(t). Again, using the fact 
that pi(t) +P2(t) = 1, add the equations for Pi(t)f(t), for i G {1,2}, to obtain 



/(*) 



7(^1+^2) t€[-T ,0] 

7(^1 + « 2 ) - /iiPi,o(*) " ^2,0 (t) t G (0,T]. 



Interestingly, the arrival distribution is piecewise continuous. It is uniform up to time 0, at which 
point service commences, and is a continuous function of t in [0, T]. Notice that when there are only 
two arriving users, the expected queue length observed by one of the arrivals is fully determined by 
the probability of idling. We have for queue i, Qi(t) = 1 x P{Q l {t) = 1) + x P{Q l {t) = 0) = P it i(t). 
Now, using the fact that Pi.o(t) + Pi.i(t) = 1 and the fact that C,(i) = aT , we can solve for Pj,i(t) 
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to obtain P iA (t) = (J 7^ h)) = 1 - Pi.o{t). Thus, we can now substitute for f(t) on (0,T] to obtain 
f(t) = (j-l^+^ + tpM^ + vt). 

By definition, we have f_ To f(t)dt = 1. Note that f(t) is a continuous function of t in the interval 
[0,T]. By assumption, F has no point masses. Thus, it follows that f(T) = 0. Now, using the fact 
that f_ T To f(t)dt = 1 we have ( 7 - l)(^i + to)(T + T ) - + /^)((1 - 7)^^ - 7T (T + T )) = 1. 
Next, using the fact that f(T) = 0, we have T = - |T . Substituting for T in terms of T 

from the expression above, and solving the resulting quadratic equation, we obtain 

These expressions describe the symmetric equilibrium strategy (F*,p*) in the case of two 
strategically arriving users and two parallel queues. The uniqueness of the equilibrium profile 
follows by construction. For given service rates and cost characteristics, it is clear that T and T 
are unique. It is easy to see that T and — T together fully determine F* and hence p*. It follows 
that the arrival profile and routing profiles are unique. ■ 
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